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(g) Image sensing apparatus having two image sensing portions and one signal processing portion 
allowing improved white balance control. 



(57) An image sensing apparatus according to the 
invention includes two image sensing portions 
(A, B), a signal processing portion (8), a first 
analog switch (7) for applying one of the out- 
puts of the two image sensing portions to the 
signal processing portion (8), a digital/analog 
converter (12) for converting the digital 
amounts of first and socond white balance con- 
trol signals for the image sensing portions into 
analog amounts, second analog switches (13, 
14) for selecting one of the first and second 
white balance control signals from the digi- 
tal/analog converter (12) and applying the selec- 
ted one to the signal processing portion, and a 
control portion 11 for controlling the digi- 
tal/analog converter 12 and the first and second 
analog switches (7, 13. 14). 
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BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates generally to image 
sensing apparatuses, and more specifically, to an 
auto white balance circuit for use in an image sensing 
apparatus such as a video camera. 

Description of the Background Art 

When one desires to obtain two image frames at 
a time using a conventional video camera, one pos- 
sible method is to select the outputs of two indepen- 
dent video cameras 15, 16 as shown in Fig. 7 and to 
record them by a VTR 18. 

According to such a method, however, though 
white balance is stable with the video cameras being 
independent, a large system will be necessary to ac- 
commodate the two video cameras, which is disad- 
vantageous in terms of cost or portability. Construct- 
ing a video camera to have two image sensing por- 
tions, one signal processing portion, and a switch 
portion for switching between the image sensing por- 
tions as disclosed in Japanese Patent Laying-Open 
No. 2-143683 provides a less costly image sensing 
apparatus. However in this case, when the image 
sensing portions are switched from one to the other, 
or when an image obtained from one image sensing 
portion is entered into a part of an image obtained 
from the image sensing portion by switching the 
switch at a high speed a number of times, white bal- 
ance is gradually disordered, resulting in difficulty in 
viewing of a reproduced image. 

SUMMARY OF THE INVENTION 

It is an object of the invention to improve the qual- 
ity of a reproduced image in an image sensing appa- 
ratus having two image sensing portions and one sig- 
nal processing portion. 

Another object of the invention is to achieve ap- 
propriate white balance in an image sensing appara- 
tus having two image sensing portions and one signal 
processing portion. 

A further object of the invention is to conduct 
quick white balance control in an image sensing ap- 
paratus having two image sensing portions and one 
signal processing portion. 

In order to achieve the above-stated objects, an 
image sensing apparatus in accordance with the in- 
vention includes a first image sensing portion for 
sensing the image of an object and outputting a first 
signal, a second image sensing portion for sensing 
the image of an objectand outputting a second signal, 
a signal processing device for subjecting the input 
signal to a prescribed processing for output, a first 
switch for selecting one of the output first signal and 



second signal and applying the selected one to the 
signal processing device, a control signal generation 
device for generating a first control signal for the sig- 
nal processing device to conduct a prescribed proc- 

5 essing to the first signal and a second control signal 
for the signal processing device to conduct a prescri- 
bed processing to the second signal, a second switch 
for selecting one of the generated first control signal 
and second control signal and applying the selected 

10 one to the signal processing device, and a controller 
for controlling the first switch so that the switch se- 
lects one of the first signal and the second signal, and 
controlling the second switch so that the switch se- 
lects the first control signal or the second control sig- 

15 nal corresponding to the selected first signal or sec- 
ond signal. 

Thus constructed image sensing apparatus con- 
ducts a prescribed processing to a signal output from 
the switched image sensing portion based on a cor- 
20 responding control signal, and the quality of a repro- 
duced image is therefore improved. 

The foregoing and other objects, features, as- 
pects and advantages of the present invention will be- 
come more apparent from the following detailed de- 
25 scription of the present invention when taken in con- 
junction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 Fig. 1 is a system block diagram showing a con- 

struction of an image sensing apparatus in accor- 
dance with a first embodiment of the invention; 
Fig. 2 is a system block diagram showing a con- 
struction of an image sensing apparatus in accor- 

35 dance with a second embodiment of the inven- 

tion; 

Fig. 3 is a flow chart for use in illustration of the 
content of control executed by the microcomputer 
shown in Fig. 2; 

40 Fig. 4 is a system block diagram showing a con- 

struction of an image sensing apparatus in accor- 
dance with a third embodiment of the invention; 
Fig. 5 is a representation showing a control func- 
tion for an image sensing portion A for use in 

45 white balance control executed by the microcom- 

puter shown in Fig. 4; 

Fig. 6 is a representation showing a control func- 
tion for an image sensing portion B for use in 
white balance control executed by the microcom- 
so puter shown in Fig. 4; and 

Fig. 7 is a diagram showing arrangement of two 
conventional video cameras disposed in parallel. 

DESCRIPTION OF THE PREFERRED 
55 EMBODIMENTS 

A first embodiment of the invention is illustrated 
as a block circuit in Fig. 1. In Fig. 1. one of an output 



2 



EP 0 533 488 A2 



signal from an image sensing portion A formed of an 
image sensing lens 1, a CCD (Charge Coupled De- . 
vice) 2, and a CDS (Correlating Double Sampling)- 
AGC (Auto Gain Control) circuit 3, and an output sig- 
nal from an image sensing portion B formed of an im- 
age sensing lens 4 ( a CCD 5, and a CDSAGC circuit 
6 is selected by an analog switch 7 and input into a 
signal processing portion 8. 

In the signal processing portion 8, the signal se- 
lected from the image sensing portions A or B is div- 
ided into chrominance signal components RGB, from 
which color difference signals R-Y and B-Y are 
formed and input into an encoder 9. In the encoder 9, 
a luminance signal and a chrominance signal are pro- 
duced and then mixed to form a video signal which is 
output to a succeeding stage circuit (not shown). 

In an auto white balance circuit of signal process- 
ing type, the RGB signals formed in the signal proc- 
essing portion 8 are converted into DC voltages in an 
integrated circuit 10, and input to a microcomputer 11. 
The microcomputer 11 subjects each of the converted 
RGB signals to an A/D conversion, and supplies to a 
D/A converter 12 white balance control data of a sig- 
nal level satisfying R = G = B. When the microcom- 
puter 11 selects the image sensing portion A, control- 
ling the switch 7 by its switch control, only a signal 
from the image sensing portion A is input to the signal 
processing portion 8. Therefore, only RGB signals 
from the image sensing portion A are input to the mi- 
crocomputer 11 through the integrated circuit 10. 
Based on the RGB signals, the microcomputer 11 de- 
cides white balance control values Rcont-A and 
Bcont-A for the image sensing portion A, and trans- 
mits these control values to the D/A converter 12 us- 
ing three lines, CLK, DATA, and LD. The D/A conver- 
ter 12 conducts D/A conversion based on the incom- 
ing data and generates DC voltages. The DC voltages 
are supplied to the Rcont and Bcont terminals of the 
signal processing portion 8 through analog switches 
13 and 14. 

Meanwhile, a signal from the image sensing por- 
tion B is stopped by the function of the analog switch 
7 and not input to the signal processing portion 8, but 
white balance control values Rcont-B and Bcont-B for 
the image sensing portion B are preferably estimated 
by a proportion calculation based on white balance 
control values Rcont-A and Bcont-A to the image 
sensing portion A. 

The estimated Rcont-B and Bcont-B are, as is the 
case with the Rcont-A and Bcont-A, transmitted to the 
D/A converter 12 using three lines, CLK, DATA, and 
LD from the microcomputer 11, and converted into 
DC voltages at the D/A converter 12 for input to the 
analog switches 1 3 and 14. At that time, with the ana- 
log switches 13 and 14 being set to pass Rcont-A and 
Bcont-A, Rcont-B and Bcont-B are not applied to the 
signal processing portion 8. 

When the microcomputer 11 receives as a switch- 



ing signal an instruction of switching between the im- 
age sensing portions Aand B from an external portion 
(operation key), the microcomputer 11 does not have 
to make a control to the D/A converter 12, but simply 
5 switches the analog switches 7, 13 and 14 by invert- 
ing switch control. This is because Rcont-B and 
Bcont-B from the D/A converter are immediately ap- 
plied to signal processing circuit 8 through the 
switches 13 and 14. Thereafter, the RGB signals from 
10 the image sensing portion B are input into the micro- 
computer 11 from the signal processing circuit 8 
through the integrated circuit 10 with a delay of the 
time constant of the integrated circuit 10, and the 
white balance control values Rcont-B and Bcont-B for 
is the image sensing portion B are determined based 
on the signals. Then, based on the determined con- 
trol values Rcont-B and Bcont-B the microcomputer 
11 estimates white balance control values Rcont-A 
and Bcont-A for the image sensing portion A. 
20 A high speed control operation of the microcom- 

puter 11 to the switches 7, 13, and 14 permits com- 
posing outputs from the image sensing portions Aand 
B. For example, suppose that a part of a picture frame 
from the image sensing portion A is placed in a picture 
25 frame from the image sensing portion B. In this case, 
if the area of the image sensing portion A is wide 
enough as compared to the area of the image sensing 
portion B, RGB signals input to the microcomputer 
can be considered as signals from the image sensing 
30 portion A. 

As described, the Rcont-A and Bcont-A are deter- 
mined, the Rcont-B and Bcont-B are estimated, and 
the respective control values are transmitted to the 
D/A converter 12. The output of D/A converter 12 is 
35 selected by the analog switches 13 and 14 for input 
to the signal processing portion 8. A high speed 
switch control by the microcomputer 11 permits the 
control voltages Rcont-A and Bcont-A to be applied to 
the portion corresponding to the picture frame of the 
40 image sensing portion A, and control voltages 
Rcont-B nd Bcont-B to be applied to the portion cor- 
responding to the picture frame of the image sensing 
portion B, thereby achieving stable white balance. 
A description of a second embodiment of the in- 
45 vention follows in conjunction with Fig. 2. The same 
reference characters as Fig. 1 denote the same or 
corresponding portions in Fig. 2. In this embodiment, 
white balance operation is achieved by an interrup- 
tion of a vertical pulse VD in synchronization with a 
so * vertical synchronizing signal. White balance is set to 
work only in response to a completion of a certain 
number of interruptions of the vertical pulse VD, not 
for every interruption of the vertical pulse VD. For 
this purpose, a VD counter is provided in a microcom- 
55 puter 11b in a programming manner. However, for a 
fixed period immediately after switching of the image 
sensing portions, white balance operation is conduct- 
ed even with a smaller number of interruptions of the 
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vertical pulse VD as compared to an usual state. This 
means time until initiation of the white balance oper- 
ation is reduced when switching between the image 
sensing portions. 

As illustrated by a flow chart in Fig. 3 t when an 
interruption of the vertical pulse VD is made, the VD 
counter is decremented by 1 in step #5, and a deter- 
mination whether or not the count value is 0 is made 
in step #10. If the count value is notO, the interruption 
routine is completed (step #50), and if the count value 
is 0, the operation proceeds to step #15, and white 
balance operation as described above is conducted. 

After the auto white balance operation is com- 
pleted, a determination whether or not a switching 
signal is externally input from other microcomputers, 
switches, or the like to the microcomputer 11b is 
made in step #20. Then, if the switching signal is in- 
put, the microcomputer 11b proceeds to step #35, 
controls the analog switches 7, 13, 14 by its switch 
control, and switches between the outputs of the im- 
age sensing portions A, B and D/A converter 12. 
Then, in step #45, the value of the VD counter is set 
to a value for high speed operation, for example, 4VD, 
thus completing the interruption routine. Thus, the 
auto white balance operation is conducted at a high 
speed. 

If in the above-stated step #20 there is not any 
switching signal, a determination whetheror not white 
balance operation is presently going on at a high 
speed is made in the next step #25 and if the high 
speed operation is going on, a determination whether 
or not a fixed time period has elapsed is conducted 
(step #40), and if the fixed time has not yet elapsed, 
the high speed operation is continued (step #45). If 
the white balance operation is not going on at a high 
speed, or it is going on at a high speed but the fixed 
time period has already run out, the value of the VD 
counter is set to a value for usual operation 1 2VD. for 
example, in step #30, thus completing the interrup- 
tion routine. Thus, after the elapsed time of 12VD 
counting value, the auto white balance operation will 
be resumed. 

In the above-described operation, after a switch- 
ing signal from an external portion (for example a key) 
is input and the image sensing portions are switched 
from one to the other, time until initiation of the auto 
white balance operation is reduced by the f ixed time 
period. 

A description of a third embodiment of the inven- 
tion follows in conjunction with a block diagram 
shown in Fig. 4. In Fig. 4, one of an output signal from 
an image sensing portion A formed of an image sens- 
ing lens 1, a CCD 2, and a CDSAGC circuit 3, and an 
output signal from an image sensing portion B formed 
of an image sensing lens 4, a CCD 5, and a CDS AGC 
circuit 6 is selected by an analog switch 7 and input 
to a signal processing portion 8. 

At the signal processing portion 8, the signal 



from the image sensing portion is divided into chro- 
minance signal components RGB, from which color 
difference signals R-Y and B-Y are formed to be input 
to an encoder 9. At the encoder 9. a luminance signal 
5 and a chrominance signal are produced and mixed to 
form a video signal to be output to a circuit of a suc- 
ceeding stage (not shown). 

In an auto white balance circuit of a signal proc- 
essing type, the RGB signals formed in the signal 
10 processing portion 8 are converted into DC voltages 
at an integrated circuit 10, and input into a microcom- 
puter 11c. The microcomputer 11c subjects them to 
an A/D conversion, and increases control signals 
Rcont, Bcont (Rcont and Bcont are DC voltages) to 
is satisfy R - G = B. This operation is called white bal- 
ance operation. 

Generally, a control function is decided from con- 
trol values Rcont and Bcont indoors which are stored 
in the microcomputer or an external EEPROM 20 at 
20 the time of manufacture and control values Rcont and 
Bcont outdoors (in some cases, in addition to these 
values, control values Rcont and Bcont under two or 
three kinds of fluorescent light), and based on the 
function, the Rcont and Bcont are controlled (see fa 
25 in Fig. 5 and fb in Fig. 6). 

Now, assume that the microcomputer 11c sets 
the analog switch 7 to select the output of the image 
sensing portion A by the function of the switch control 
output signal. At that time, only the signal of the im- 
30 age sensing portion Ais input to the signal processing 
portion 8, and the white balance of the image sensing 
portion Ais made by an auto white balance operation. 
Now, suppose that the control value of the image 
sensing portion A in an auto white balance operation 
35 resides at point X in Fig. 5. At that time, the following 
calculation is conducted for estimating the control 
value of the image sensing portion B to some extent. 

In Fig. 5. assume that the difference between the 
control value Rcont outdoors and the control value 
40 Rcont indoors is Ra, the difference between the con- 
trol value Rcont at point X representing the control 
value at present and the control value Rcont indoors 
is Rx, while in Fig. 6, the difference between the con- 
trol value Rcont outdoors of the image sensing por- 
45 tion B and the control value Rcont indoors is Rb, and 
the difference between the control value Rcont at 
point Y to be estimated and the control value Rcont 
indoors is Ry. Assuming that a proportional relation 
is established between these values, let R = (Rx x 
so Rb)/ Ra hotd. Similarly, let the control value Bcont at 
point Y be represented as By = (Bx x Bb) /Ba. Thus, 
if point X representing t he control values of one image 
sensing portion changes, point Y representing the 
control values of the other image sensing portion is 
55 estimated following the change. 

When a switching is made from the image sens- 
ing portion A to the image sensing portion B, the mi- 
crocomputer 11c switches its switch control for the 
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analog switch 7, and switches the control values from 
the Rcont and Bcont to the control values at point Y 
which has been estimated from the control values of 
point X. Similarly, when a switching is made from the 
image sensing portion B to the image sensing portion 
A, point X is estimated from point Y and the control 
values are switched accordingly. 

When the image sensing portions are switched 
by the above-stated operation, the control values 
which have been previously estimated are output, and 
a substantially white balance match state is achieved. 

As in the foregoing, according to the invention, 
the moment the image sensing portions are switched 
from one to the other, white balance is substantially 
established, and stable white balance is provided 
when two picture frames are mixed into one. 

According to the invention, when objects under 
different conditions are image-sensed by the two im- 
age sensing portions, white balance shift created by 
a switching operation can quickly be corrected, and 
white balance follows a switching between picture 
frames with an improved accuracy. 

Although the present invention has been descri- 
bed and illustrated in detail, it is clearly understood 
that the same is by way of illustration and example 
only and is not to be taken by way of limitation, the 
spirit and scope of the present invention being limited 
only by the terms of the appended claims. 



Claims 

1. An image sensing apparatus, comprising: 

a first image sensing portion (A) for sens- 
ing the image of an object to output a first signal; 

a second image sensing portion (B) for 
sensing the image of an object to output a second 
signal; 

signal processing means (8) for subjecting 
an input signal to a prescribed processing to out- 
put a signal; 

first switching means (7) for selecting one 
of said output first signal and second signal and 
applying the selected signal to said signal proc- 
essing means; 

control signal generation means (11 a, 11 b) 
for generating a first control signal for said signal 
processing means to conduct said prescribed 
processing to said f irst signal, and a second con- 
trol signal for said signal processing means to 
conduct said prescribed processing to said sec- 
ond signal; 

second switching means (13, 14) for se- 
lecting one of said generated first control signal 
and second control signal and applying the se- 
lected signal to said signal processing means; 
and 

control means (11a. 11b) responsive to a 



switching signal for controlling said first switching 
means to select one of said first signal and sec- 
ond signal, and controlling said second switching 
means to select one of said first control signal and 
5 second control signal corresponding to said se- 

lected one of the first signal and second signal. 

2. An image sensing apparatus recited in claim 1, 
wherein 

to said prescribed processing includes white 

balance control to the chrominance signal of the 
input signal. 

3. An image sensing apparatus as recited in claim 2, 
is wherein 

said control signal generation means gen- 
erates a white balance control value based on the 
chrominance signal of one of said first and sec- 
ond signals input to said signal processing means 
20 and to be subjected to said prescribed process- 

ing. 

4. An image sensing apparatus as recited in claim 3, 
wherein 

25 said control signal generation means con- 

ducts a prescribed operation based on said gen- 
erated white balance control value to generate 
the white balance control value of the other sig- 
nal of said first and second signals. 

30 

5. An image sensing apparatus, comprising: 

two image sensing portions (A, B) each for 
sensing the image of an object to output a signal; 

one system of signal processing portion 
35 (8) for subjecting an applied signal to a prescribed 

processing; 

a first analog switch (7) for applying one of 
the outputs of said image sensing portions to said 
signal processing portion; 
40 a digital/analog converter (12) for convert- 

ing the digital amounts of first and second white 
balance control signals for said image sensing 
portions, respectively to analog amounts for out- 
put; 

45 a second analog switch (13, 14) for select- 

ing one of said first and second white balance 
control signals output from said digital/analog 
converter and applying the selected signal to said 
signal processing portion; and 

50 control portions (11a, 11b) for controlling 

said digital/analog converter, and first and sec- 
ond analog switches. 

6. An image sensing apparatus as recited in claim 5, 
55 wherein 

said control portion is formed of a micro- 
computer, and said microcomputer forms said 
white balance control signal based on a chromi- 
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nance signal from said signal processing portion 
and applies the signal to said digital/analog con- 
verter. . 

7. An image sensing apparatus having an auto white 
balance function formed of a signal processing 
portion (8) for processing signals applied from im- 
age sensing portions (A, B) f and a control portion 
(11a f 11b) for applying a white balance control 
signal based on a chrominance signal applied 
from said signal processing portion to said control 
signal processing portion, comprising: 

two image sensing portions each for sens- 
ing the image of an object to output a signal; 

a first switch (7) for applying one of the 
outputs of said image sensing portions to said 
signal processing portion; 

a second switch (13, 14) for selecting one 
of said white balance control signals respectively 
for said image sensing portions output from said 
control portion and applying the selected signal 
to said signal processing portion; and 

control means (11a, 11b) for controlling 
switching between said first and second 
switches. 

8. A white balance circuit for a video camera having 
two image sensing portions (A, B) and one signal 
processing portion (8) and capable of image- 
sensing by switching between said image sens- 
ing portions, comprising: 

auto white balance control means (11a t 
11b) for forming a white balance control signal 
based on a chrominance signal from said signal 
processing portion and conducting white balance 
control of the chrominance signal in said signal 
processing portion by said white balance control 
signal at prescribed intervals; 

execution means for executing said white 
balance control at intervals shorter than said pre- 
scribed intervals in a time period for processing 
when said image sensing portions are switched 
between each other. 

9. A white balance circuit as recited in claim 8, 
wherein 

said prescribed interval is decided by a 
prescribed number of interruptions of a vertical 
pulse (VD) in synchronization with a vertical syn- 
chronizing signals. 

10. A white balance circuit as recited in claim 9, 
wherein 

when said image sensing portions are 
switched between each other, white balance con- 
trol is executed by a smaller number of interrup- 
tions of the vertical pulse (VD) than said prescri- 
bed number. 
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11. An image sensing apparatus having an auto white 
balance function formed of a signal processing 
portion (8) for processing signals applied from im- 
age sensing portions (A, B) and a control portion 
(11c) for applying a white balance control signal 
formed based on a chrominance signal applied 
from said signal processing portion to said signal 
processing portion, comprising: 

two image sensing portions each for sens- 
ing the image of an object to output a signal; 

a switch portion (7) for applying one of the 
outputs of said image sensing portions to said 
signal processing portion; 

storage means (20) for previously storing 
the white balance adjustment data of said image 
sensing portions; 

estimation means (11c) for estimating a 
white balance control signal for an image sensing 
portion which is not selected at the moment 
based on said stored adjustment data and the 
white balance control signal for the image sens- 
ing portion selected at present; and 

control means (11c) for setting said esti- 
mated white balance control signal as a white bal- 
ance control signal for said switched image sens- 
ing portion, when the outputs of said image sens- 
ing portions are switched by said switch portion. 

12. An image sensing apparatus as recited in claim 
11, wherein 

said adjustment data includes a white bal- 
ance control value indoors and a white balance 
control value outdoors. 
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FIG. 3 
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